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CO . Abstract 

In this paper, we give sufficient conditions to establish central limit theorems for boundary 
f"H ■ estimates of Poisson point processes. The considered estimates are obtained by smoothing 

, some bias corrected extreme values of the point process. We show how the smoothing leads 

Gaussian asymptotic distributions and therefore pointwise confidence intervals. Some new 
unidimensional and multidimensional examples are provided. 
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1 Introduction 



Many proposals are given in the literature for estimating a set S given a finite random set N of 
points drawn from the interior. This problem of support estimation arises in classification (Hardy 
& RASSON (1982)), clustering problems (Hartigan (1975)), discriminant analysis (Baufays & 
Rasson (1985)), and outliers detection (Devroye & Wise (1980)). Applications are also found 
in image analysis. For instance, the segmentation problem can be considered under the support 
estimation point of view, where the support is a connex bounded set in K 2 . We also point out some 
applications in econometrics (e.g. Deprins, et al (1984)). In such cases, the unknown support 
can be written 

S = {(x,y) :xe E; < y < f(x)}, (1) 

where / is an unknown function and E an arbitrary set. The set S is often called a boundary 
fragment, see Korostelev & Tsybakov (1993), Chapter 3. Then, the problem reduces to 
estimating /, sometimes called the production frontier (see for instance Hardle et al (1995a)). 
The data consist of pair (X,Y) where X represents the input, possibly multidimensional (labor, 
energy or capital), used to produce an output Y in a given firm. In such a framework, the value 
f(x) can be interpreted as the maximum level of output which is attainable for the level of input x. 
Korostelev et al (1995) suppose / to be increasing and concave, from economical considerations, 
which suggests an adapted estimator, called the DEA (Data Envelopment Analysis) estimator. Its 
asymptotic distribution is established by Gijbels et al (1999). 

Here, N is a Poisson point process, with observed points belonging to a subset S defined as in (fT]) 
where / is an unknown function which needs not to be monotone. An early paper was written by 
Geffroy (1964) for independent identically distributed observations from a density. The proposed 
estimator is a kind of histogram based on the extreme values of the sample. This work was extended 
in two main directions. 
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(a) On the one hand, piecewise polynomials were introduced and their optimality in an asymp- 
totic minimax sense is proved under weak assumptions on the rate of decrease /3 of the 
density towards and on the number q of continuous derivatives of / by Korostelev & 
TSYBAKOV (1993) and by Hardle et al (1995b). The asymptotic distribution is established 
by Hall et al (1998). Extreme values methods are proposed by Hall et al (1997) and by 
Gubels & Peng (1999) to estimate the parameter j3. 

(b) On the other hand, different propositions for smoothing Geffroy's estimate were made. Gi- 
RARD & Jacob (2001, 2003a, 2003b) introduced estimates based on kernel regressions and on 
projection methods. In the same spirit, Gardes (2002) proposed a Faber-Shauder estimate. 
In each case, the consistency and the limit distribution of the estimator are established. 

Finally, the work of Mammen & Tsybakov (1995) offers a general framework for comparing 
the estimates of type (a) or (b). The optimal rates of convergence are derived for estimates 
of boundaries which have a smooth parametrisation. The existence of estimates reaching these 
optimal rates of convergence is proved by the minimization of contrast criteria over classes of 
functions. 

Here, we introduce new estimates of type (b). The considered estimates are obtained by smoothing 
the bias corrected extreme values of the Poisson process (see Menneteau (2003a) for related work 
in the iid setting). 

This approach offers several advantages. First, the bias correction allows to overcome the 
classical limitation due to the fact that the data lie below the boundary. Second, the smoothing 
permits to obtain Gaussian asymptotic distributions. Therefore, it is straightforward to obtain 
pointwise confidence intervals for f(x) all the more so as our estimates benefit from explicit forms 
and are easy to compute. Finally, let us note that our estimates offer new features compared to 
those quoted in (b): i) They are not dedicated to unidimensional boundary estimation problems 
since there is no restriction on the set E in (JTJ, ii) the bias correction is different and thus, iii) 
the intensity measure of the point process can be more general, iv) the smoothing is achieved with 
more general weight functions allowing v) better speeds of convergence than the previous estimates 
quoted in (b). 



2 The boundary estimate 

Let (E,£,v) be a probability space and / : (E,£) — > (M. + ,B(M. + )) a measurable function, where 
B (E) is the Borel cr-algebra on K. Consider S = {(x, y) £ E x R, < y < f(x)} and the sequence 
of Poisson point processes 

N n = {N n {D):D e£®B (K+) } , n > 1, 

with intensity measure 

nc(u®\)l s , (2) 

where c > 0, and A is the Lebesgue measure on K + . Let {(X n ^, Y n i), 1 < i < N n (S)} be the set 
of points associated to the point process. Our aim is then to estimate S via an estimation of /. 
Let k n f oo and denote by {I n , r '■ 1 < f < k n } a measurable partition of E. For all 1 < r < k n , 
note v n , r = v{I n ,r), 

D n ,r = {(x, y) : x e J n , r , < y < f(x)} 
the cell of S built on J„ >r and iV n r = N n (D n _ r ). We introduce the extreme values 

max{^n^ ' ^ -^n,r}> 

if N ntr and Y* r = otherwise. In the following, the convention x oo = is adopted. For 
x G E, our estimator of / (x) is 

fn ( X ) ='^>2vn,rKnA X ) ( 1 + Y n,r> ( 3 ) 
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where n n ^ r : E — > R is a weighting function determining the nature of the smoothing introduced in 
the estimate. In the next section, some general conditions are imposed on K„ jr and examples are 
provided in Section [5] It is well-known that Y* r is an estimator of the maximum of / on I n ^ r with 
negative bias. The use of the random variable (1 + N~\)Y* r allows to reduce this bias. This bias 
correction is motivated by the remark that, conditionally on N n r , Y* r has approximatively the 
same distribution as the maximum of N n r independent random variables uniformly distributed on 
[0,min{/(:r) : x £ I n ,r}] (see Lemma [T] ii) below). Therefore, /„ appears as a linear combination 
of extreme value estimates of sampled values of /. The asymptotic properties of /„ are established 
in Section [31 and proved in Section 3J Illustrations are presented in Section [5] with general kernel 
estimates including Parzen-Rosenblatt and Dirichlet kernels. 

3 Main results 

Define v n — vaa\\v n ri 1 < r < k n } and 

/ fc. X V» 

K n (x) = I 2j/4 jr (a;)J , x€ E. 

Let m = sup{a > : v ({/ < a}) = 0} and M = inf{a > : v ({/ > a}) = 0} be the ^-essential 
infimum and supremum of / on E. Similarly, for all 1 < r < k n , let 

m n , r = sup{a > : v ({/ < a} (1 I n . r ) = 0}, 

M n , r = inf{a > : v ({/ > a} n I n , r ) = 0} 

and 

fn.r = V'). J f dv 

be respectively the ^-essential infimum, the ^-essential supremum and the mean value of / on I n r 
and define the ^-essential oscillation of / on I n ^ r by 

A„ = max{M„ ir - m n , r , 1 <r < k n }. 

Let us highlight that, in most applications (see Section [S]), E is a subset of R d , v is absolutely 
continuous with respect to Lebesgue measure and / is continuous. Hence, all essential infima and 
essential suprema considered below reduce to the classical minima and maxima. 
Finally, set w n ^ r (x) = K n . r (x) / n n (x). We consider the following series of assumptions: 
(H.l) k n j" oo and nv n — s- oo as n — > oo. 

(H.2) < m < M < +oo and 

S n := max v n ,r{Mn,r — vrinr) = (I/ 71 ) as rt — > oo. 

l<r<k n 

There exists F C E such that: 

(H.3) For each (x±, ...,x p ) C F, there exists a covariance matrix £( Xl) _ !X ) = [u{xi, a;j)]i<i,j<p in 
R p such that for all 1 < i, j < p, 

k„ 

w n r {xi)w n ^ r {xj) (j{x i: Xj) as n — > oo. 

r=l 

(H.4) For all x G F, 

max \w n r (x)\ — ¥ as n —¥ oo. 

l<r<fe„ 

(H.5) For all x e F, 

r=l 



K n (x) 



as n — ^ oo. 
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(H.6) For all x G F, 



|w„, r (a;)| max (^(nd n ) 2 , nv n exp (— mcnv n ) , A„^ — > as n — > oo. 

r=l 

Before proceeding, let us comment on the assumptions. (H.1)-(H.4) are devoted to the control 
of the centered estimator f n (x) — E(/„ (a;)). Assumption (H.l) imposes that the mean number 
of points in each D n ^ r goes to infinity. (H.2) requires the unknown function / to be bounded 
away from 0. It also imposes that the mean number of points in D n r above m n ^ r converges to 
0. Note that (H.l) and (H.2) force the ^-essential oscillation of / on I n r to converge uniformly 
to 0: A„ — > as n — > oo. (H.3) is devoted to the multivariate aspects of the limit theorems. (H.4) 
imposes to the weight functions n n r (x) in the linear combination (J3|) to be approximatively of 
the same order. This is a natural condition to obtain an asymptotic Gaussian behavior. These 
assumptions are easy to verify in practice since they involve either f(x) or K n ^ r (x) without mixing 
these two quantities. Assumptions (H.5) and (H.6) are devoted to the control of the bias term 
E(/„ (xj) — f(x). They prevent it to be too important with respect to the variance of the estimate 
(which will reveal to be of order K n (x) /n) . Consequently, these two assumptions involve both the 
unknown function f(x) and the weight functions K n ^ r {x). Finally, (H.6) can be looked at as a 
stronger version of (H.2). 

Our first result states the multivariate central limit theorem for f n [x). 
Theorem 1 Under assumptions (H.1)-(H.6) , and for all (x\, ...,x p ) C F, 

(/„ ( Xj ) - / ( Xj )) : 1 < j < p} £ N (0, E (si ,..., ap) ) , 

where c is defined in (0) , — > denotes the convergence in distribution and N (0, S( Xl) ... )Xp )) *- s the 
centered Gaussian distribution in W , with covariance matrix ~£>( Xl ,...,x p )- 

In practice, c is not known and has to be estimated. In this aim, we introduce c„ = N n (S)/(ria n ), 
where 



a n = > v n , 1 + — — Y. 



r—1 



l 



is an estimator of a = J E fdv. We then have the following corollary: 
Corollary 1 Theorem [7] holds when c is replaced by c n . 

For all x € F, this leads to an explicit asymptotic 7th confidence interval for f(x): 



,r=l 



where z 1 is the (7 + l)/2th quantile of the N(0, 1) distribution. Note that the computation of this 
interval does not require a bootstrap procedure as for instance in Hall et al (1998). 
Remark. In the case where the measure v is unknown, it is natural to introduce the boundary 
estimate: 



/„(•'■) =X;^n J rKn,r(a:)(l + ^-)r,;.,.. (4.1 
r—1 



where v n>T is an estimator of u n ,r- If no prior information is available on v 1 one can use the 
following non-parametric estimate: 

o N n .r 



™' r ncT* r (l + JV^)' 

leading to 



fn( x ) = y~.Kn,r{ x )— ~ 

* — ' nc 

r—1 
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which has been first introduced by Jacob & Suquet (1995) with a particular choice of the 
weighting function k„ t and when v is the Lebesgue measure. Let us note that Theorem [T] does 

o 

not hold for f n since it converges slower than f n , see Jacob & Suquet (1995), Theorem 7. If 
v is assumed to belong to a parametric family, another versions of (U]) can be used, leading to 
semi-parametric estimates of /. 



4 Proofs of the main results 

The proofs are built as follows. First, we establish a multivariate central limit theorem for the 
finite dimensional projection of the centered process 



nc 



x G F 



(see Proposition [T] below) . To this aim, by the general framework of the appendix (Theorem [3]) it 
is sufficient to control the centered moments of 

This is achieved in Lemma [3J In a second time, we establish that the bias term 

-^(e (/„(*)) -f(x)) 

vanishes when n f oo (see Proposition [5]) . Finally, we prove in Lemma [3J that c can be replaced 
by c n in the multivariate central limit theorem. Before that, we introduce some new notations 
and definitions needed for our proofs. For all 1 < r < k n , each cell D n r can be splittcd as 

D n ,r — D n ,r U D~ r U D+ r where 

• D rhr = {(x,y) G I n ,r x [0,m n/ ], / (x) < m n ^ r }, 

• D~ r = {(x,y) E D n ^ r , < y < m„ !r } = (I, hr x [0,m„, r ])\-D„, r , 

• Atr = {(^2/) : x € I n , r , m„, r <y < f (x)} . 
Moreover, for all 1 < r < k n , set 

• ^n,r — ncv nr m nr , 

. tf- r = iV„ (Z>- r ), 7V+ r = N n (D+ r ), 

• Z~ r = ncv n:r max{F„^ : (X n ^, Y n ^) G D~ r }, if iV~ r ^ 0, and = otherwise, 
Z+ r — ncv n: r max{F„^ : (X n> i, Y n ^) G D+ r }, if iV+ r 7^ 0, and Z+ r = otherwise, 

Some technical results are collected in Lemma [T] The second of them is the key tool for proving 
the following ones. It states that, conditionally on N~ r , Z~ r has the same distribution as the 
maximum of N~ r independent random variables uniformly distributed on [0, A„ ir ]. This motivates 
the bias correction in ([3]). 

Lemma 1 Under assumptions (H.l) and (H.2) we have 

i) max P (N+ r > 0) = O (nS n ) = o (1) . 

l<r<k n ' 

ii) For all I <r < k n , and any t € [0, A n , r ], P (Z~ r < t \ N~ >r ) = i j^j . 

Hi) For all 1 < r < k n , and any t G [0, X n . r ], P {Z~ r < t) = exp(i — A„., ). 
iv) For alll<r< k n , E (Z~ ) = X n . r - (l - e- A ™' -) . 



5 



v) For alll<r < k n , V(Z~ r ) = 1 - 2A Iljr e- A "'' - e" 2 ^- . 

vi) For alll<r< k n , E (jf^A = 1 - e~ X "' r (1 + K,r) ■ 

vii) For alll>\ and 1 < r < k n , E < £1 

viii) max V ( 5-' r I = o(l). 
y i<r<fe„ V^W v ; 

kcJ For alU>\ and 1 < r < fc n , E f |Z~ r - E (Z,;,,) |^ < 1 + £!. 

For a?/ 1 > 1, max E (|£„ r - £~ r |*) = 0(n<5„). 

l<r<fc 71 ' 

sij max |E (Z* l r ) — /i n>r + l| = ^max ^cxp (—mncv n ) ; (n5 n ) 2 ^ . 
Proof, i) is straightforward. 

ii) First, note that, since (y <E> X)(D n ,r) = 0, then for all A E B (R+) , 

N n (D- p n (Z n , r x A)) = 7V„ (J„ ir x ([0,m„, r ] n A)) a.s. 

which is a Poisson random variable with mean ncv n ^ r X ([0, m„ !r ] n A) . Second, set t e [0, A„ !r ] , 
and define t n _ r — t/(nci> n _ r ). Then, for all q > 1, 

P (Z- r < t | N~ r = q) 
_P (N n (D- n (I„, r x [0,t n , r ])) = g) P (JV n (£>- r n (/„, r x (t„, r , +oo))) = 0) 



P (JV„ (Dn,r) = q) 

t 



A„ 

Noticing that (J5j> is obvious when g = gives the result. 
iii)-v) are deduced from ii) by easy calculations, 
vi) It follows from ii) that 

E ( = E ( ^^>E ( Z - p | N- r )) = X n r E ( = 
= 1 - e~ A — (1 + A n , r ) . 



vii) We have, 



N n .r) ) \\N nt r) V '// \ (^r) (* + JV£r) 

p (g + l-l)! Ag 
^ flg'-ig! {q + £) 



since for all I and g, (g + I - 1)! < flg^g!- 
viii) By flBJ} with £ = 2, 

7- \ 2 \ 00 / 1 \ \q+2 

n. r \ 1 X ^ / - J- \ 7i r 



N ",rJ J ^ \ 3/ (« + 2 ) ! 



Now, since, 



max e~ A " r f 1 + A„ r + ^Ihl | < max e~ x (l + X+ — ) = oil) 

l<r<k n \ 2 \>mncv n V 2 ' 



(5) 



^ ( g + ^-l)! 



G 



and for all Q > 1, 

oc 1 X q+2 Q \g+2 -, oo , g+2 

— : —rne ™ ,r < max > 7 —re " ,r + — max > -. —rne 

.... _ i q(q + 2)\ ~ i<r<fe„^(q + 2)! Qi<Kfc„^ ( 9 + 2)! 

<o(l) + i 

it follows that 

2\ 



max 

KKL 



E 



Z n,r 
Nn.r 



(1). (7) 



Collecting ([7]) and vi) gives the result, 
ix) Note that 



/>+oo 

E (\Z- r - E (Z- r ) \ t )=t t^P (\Z~ r - E (Z- r ) I > t) dt. 



Moreover, by hi) and iv), 

P(\Z~ r -K (Z- r ) I > t) = P (Z- r > E (Z" r ) + 1) + P (Z- r < E (Z- r ) - t) 

= [l-exp(t- A„, r + E(Z~ r ))] l[ 0) A n , r -E(z- r )](*) 
+ exp - A„ !r + E (Z~ r )) l[o, E (z- r )] (*) 
< l [0 ,i] (t) + exp (e- A — - 1) e~*. 



Hence, 



E (|Z- r - E (Z- r ) \)<tj + ex P ( e " A "'" " 1) ^ 

< 1 + exp (e~ A " r - l) i\. 
x) Since Z* n r = (Z+ r - Z~ r ) l| JV + t , >0 j. + we ge 



mt 



1 \ , , s / 1 



&,r - Cn.r ~ [ 1 + J (Z n .r ~ Z n>r ) l {<r>o} + Z„ )P I - ^ ^_ 



iV, 

:= 7n,r,l + 7n,r,2 + 7n,r,3 + 7n,r,4 

Hence, by the triangle inequality, 



(\ ( t\ 1/e 

First, 



max E 

l<r<k n 

Second, by iv): 



(l7n,r,irj < 2nc max !/ n , r (M n , r - m„, r ) P (7V+ r > 0) = o (n* n ) . (9) 



/ t \ l/e 

max E f |7n,r,2| < 2 max P (N+ r > 0) = O (nS n ) . (10) 

Kr<fen V / Kr<k n ' 



Third, the independence of N+ r and Z n r yields with ix) 

l/e 



max 

Kr<k 



E (|7n,r,3|0 <2(l+^!) 1/£ max P (7V+ r > 0) = O (n5 n ) . (11) 

7i V / l<r<k n ' 
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Finally, since |7 n ,r,4| < Ki,r(N n r + 1) >0 | and taking into account that 

E ( (N~ r + iy e ) = eW-if* + /"-"i. e^"- < flA^., (12) 



(where we used the fact that for all I and q, (q + £)! < (q + 1) •£!<?!), we get 

l/t 



max E 

Kr<k n 



The result is a consequence of (JSJ) — (|T3 
xi) Note that 

E(Y* ) = / ' P(Y* >u)<fo 



(| 7 „, M | £ ) < i m^A n , r E((JV- p + l) £ ) P« r >0) 

< (£l) 1/e mm P (iV+ r > 0) = O (nS n ) . (13) 



' (1 - P (N n (D nir n (J n , P x [u, M n , r ])))) du+ P (Y„* r > u) du 

J m nr 
rM n , r 

(1 — exp {—ncv n ^f n ^ r + nw„, r ti)) du + P (Y^ r > u) du 

m ntr ~ [ncv n , r )~~ exp {-ncv n%r {f n%r - m n>r )) + {ncv n , r )~~ exp {-ncv nir f n , r ) 

M„, r 

p (r„% > u) du. 



Hence, 



max E (Z* r ) — [i n r + 1 

l<r<k n ' 1 

< max \ncis n , r (f n ,r — m n , r ) - 1 + exp (—ncv n , r (f n r - m n r ))\ 

l<r<k n 

+ exp (—ncv n m) + nc max v n r P [Y* „ > m n r ) (M n r — m n r ) 

l<r<fc„ ' v ' ' ' 

< max fe - ' + 1 — l) + exp (—ncv n rn) + O { (nS n ) 2 ) 

0<t<cnS n V ' V J 

= O ^max ^exp {—mncv n ) ; (nS n ) 2 ^ . 

■ 

In the next lemma we give an uniform upper bound on the centered moments of and an 

exact uniform control of the variances and expectations. 

Lemma 2 Under assumptions (H.l) and (H.2) we have 
i) limsup maxjiy max E ( |£ n r — E (£„ r )| ) < 1. 

n->oo ^>2 *■ l<r<fc„ V ' / 

mJ max |V(f n , r )-l| = o(l). 

l<r<k n 

Hi) max |E (f nr - Mn,r)| = O (max ((ni5 n ) 2 ,m/ n exp {-mcnv n ) , A n ) ) . 

l<r</c n V \ / / 

Proof, i) It is easy to see that 

i max^E(|Z- r -E(Z- r )f) , 



max E (\£ n r - E (£„ r )|^) < 3 £ max 
i<r<fc„ V / j 2 £ max E| 

Kr<fc„ 



l<r<fe n V / 



and the result follows from Lemma [T]vii), ix) and x). 

ii) Introduce for the sake of simplicity 7„. r = £„. r — Z~ r = (^ n ,r — Cn.r) + (^nr/^nr)- This yields 
V (U r ) - V (Z- r ) + 2Cov (Z~ r , 7 „ >r ) + V ( 7 „, r ) 
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and we thus have, 



max | V (£ n ,r) - 1| < max | V {Z~ r ) - l| + max V ( 7n , r ) + 2 max V ( 7n , r ) V (Z" r ) 

IXrfC/c^ l<r<k n l<r<k n l<r<k n 

Lemma [T]v) shows that 

|2A TljT .e _A "''' + e - 2A "--| =o(l). 



1/2 



max 

Kr<k r , 



|V(Z" r )-l|= max 



Besides, 



max V (7„ r l < 2 max V 

l<r<fc„ ' l<r<k n 



(^A + 2 max E (|£„, r - £_| 2 ) - °(1) 

\NnrJ l<r<k n 



by Lemma [T] viii) and x) in the particular case where £ = 2. 
iii) First, by the triangle inequality and Lemma Q] (vi) , 



max 

l<r<k„ 



E ( Z »A 


- 1 


< max 


\N n , r J 




l<r<fc„ 



max 

Kr<k n 



< max 

Kr<k„ 



+ max 

Kr<k„ 



E 



XZ-1) 1{<.>0} 



S Z+ r -E(N n , r ) 
7V„, r - E {N n<r ) 



1 {AT+ r >0}) 



N„ 



l {N+ r >o} 



+ O (nv n exp {—mcnv n )) . 

(14) 



Now, since E (N„ fr ) — (J, n ,r, we get using LemmaQ] (ii) and (IT2 



max 

Kr<fc„ 



E 



/ Z+ r -E(JV n|I .) 



L {jV—> } 



< ncS n max E ( (N„ „ + 1) 

Kr<fe„ V V ' y 



«r > 0) 



(15) 



Moreover, 



max 

Kr<fc„ 



E 



jV», r - E (JV n , r ) 
AT 



L {N,tr>0} 



< max 

l<r<fc„ 



max 

KKt, 



E 



E 



l {jv+».>o} 



{w+ r >o} 



(16) 



and since for all large n, max E (iV+ r ) < nc<5„ < 1, we get eventually, using (fT2")) again, 

l<r<fe n ' 



max 

l<r<fe„ 



E 



' iV+ r -E(iV+ r ) \ x 



N n , 



{w+ r >o} 



' N+ r -E(N+ r ) \ 

v J 1 {<">°} / 

/ iV+ r -E(JV+ r ) > \ 

AT- r + l y | 1 {^>°} / 

i m^E((JV- r + l) _1 )E(iV+ r ) 



max E 

l<r<fe„ 



< max E 

l<r<k„ 



< 



< max A„ r ncv n r (M n r — m n r ) 

l<r<k n ' ' ' 

= 0(A„). 



(17) 
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Finally, since, for all r < k n , 

E 



Nz r -E(N- r ) \ 

KZ Vv>°} 



< 



< 



< 



< 



E 



E 



' N- r -E(N- r ) ' 

v Nn,r + 1 

f N- r -E(N- r y 

v Nn,r + 1 
' N- r -E(N- r y 

K Nn,r + 1 

' jV- r -E(JV- r ) ' 

Nn.r + 1 



'(JV+ r = l)+X> 



i>2 



|iV- r -E(JV- r )| 

A^ r + j 



'«r=i) 



• « r = 1) + E ( ^"^-^ r)l ) P «r > 2) 
' > «, = l) + (vfc)E((iV- r + 



l)- 2 )) 1/2 F(iV+ r >2) 



'(iV+ r = l)+ (P(iV+ r >2)) 



with 



A^r + 1 



g=0 



(9 + 1)! 



g=0 

OO 



(g+iy. 



(«+!)! 



A'.'. 



'"> r -A», 



9=1 



E 

9=1 



:A-j,(A„, r -l + e- A "-)-(l 
: — \i,r + e A "' r (l + \i,r) ; 



A 9 

__L_ e A, 

?! 



and 



Kr > 2) < E 



c -nc5„ 



q=2 



we get collecting (JT4J) - (50]) that 



max 

l<r<fe„ 



E 



< (nc5 r , 



= O ( max f (n6 n ) 2 , A 



As a conclusion, Lemma Q](xi) yields: 



max 

l<r<fc„ 



|E (£„. r - Hn,r)\ < max I E (-^n r) ~ AW + l| + max 



E 



^max ^(n<5„) 2 , nv n exp {—mcnv n ) , A, 



(18) 



(19) 



(20) 



Proposition 1 Under assumptions (H.l) — (H.4) and for all (xi, ■■.,x p ) C F, 



lie 



; ( r (/„ fo) - E (/„ (xj))) : 1 < j < p| ^ JV (0,S (xii ..., Xp) ) . 

Proof. The proof is based on Theorem [3] in the Appendix: For all 1 < r < k n , set 

Cn,r — Cn.r — E (£n,r) and iu n ,r = (ifn,r (#i) , it>n,r (^p)) • It is easily seen that 

n k„ 

{In (Xj) - E(f n (XjU^ : 1 < j < p { = E W n,'Cn,r, 



nc 



l^n \Xj ) 

where the ((n,r) 1<r<k are independent. Then (H.3), (H.4) and Lemma [2] i), ii) show that the 
assumptions of Theorem [3] are satisfied. ■ 
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Proposition 2 Under assumptions (H.l) , (H.2) , (H.5) , (H.6), we have for all x E F. 



-^(e (/„(,)) -/(*)) 



as n — > oo. 



Proof. For all x € F, we get, by the triangle inequality and assumption (H.5), 



(/„(*)) -/(*) 



K n (a;) 

^ Ifn.r (z) (IE (£n,r) - Mn,r) 



/(*) 



r=l 



r=l 



^ ^ U)n,r (^) l^n.r 
r=l 

^ y^l U '«,'-( a; )l max l E (Cn,r) - Mn,r| + o(l). 
\ — / Kr</c„ 



/(*) 



K n (a;) 



Lemma [2] iii) and condition (H.6) give the result. ■ 

Theorem [T] is a straightforward consequence of Proposition Q] and Proposition [5J The following 
lemma shows that c„ converges to c almost surely. In particular, it implies that c can be replaced 
by c n in the above theorem. 

Lemma 3 Under assumptions (H.l) and (H.2), for all S > 0, there exist as > and n$ > sitc/i 
f/iai Vn > na, P(|c„ — c| > <5) < 3 exp (— nag). 



Proof. We have 



1 1 

a n a 



\c n — c\ < -^^\N n (S) — nac\ + ac 
na n 

Let 8 > and r/s = min(a/2, a<5/(4c)). Then, 

~ ~ / 2 2c?7i\ 

|c„ - c| < |c„ - c|l{|^ n _ | >J)a } + lA^OS) - nac| H I l{\a n -a\<ri s }, 



and therefore 



¥(\cn - c\ > 6) < P ( — |JV„(5) - nac\ > ^ ( <5 
na 2 



2cr/s 



+ P(|a„ -a\> ns) 



< 



N n (S) 



+ ¥{\a„-a\ >n s ). 



(21) 



Let us consider the first term of (|21[) . Since N n (S) has a Poisson distribution with mean nac, it 
can be expanded as N n (S) — X)fc=i 7r fc' where the irk are independent Poisson random variables 
with mean ac. Introducing A^(s) = logE(e S7r ) = ac(e s — 1) and denoting 



A*(t) = sup(si- A^s)) 



i log (t/ac) -t + ac if t>0 
+oo if t < 0, 



Cramer's theorem (see Dembo & Zeitouni (1991), Theorem 2.2.3) yields 



lim sup — log I 

n— f oo n 



iV„(5) 



<5 <S 
C "4' C+ 4 



<-inf \K(t), t 



c , c 

4 



< 0. 



Consequently, there exists a' s > such that 



Vn > 1, 



JV„(5) 



7(0 



C "4' C+ 4 



< exp (—na' s ). 



(22) 



Consider now the second term of (1211) and observe that 



E(a n ) - a = — V7E(£ n r ) - /i r , 
nc * — ' 
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Lemma iii) implies that 

k 

\E(a n ) - a\ = — (max (A n , (nS n ) 2 , nv n exp (-mncv n ))) 
n 

which converges to under (H.l) and (H.2). Therefore, there exists n$ > such that 



Vn > n s , P(|a„ - a\ > m ) < P(|o» - E(a„)| > w/2) 



£((^, r -E(C„, r )) 



> rjsnc/2 , 



and in view of Lemma H i), applying Bernstein's inequality (see Shorack & Wellner (1986), 
p. 855) yields that for some constants C\ and C 2 , 

/ 2 2 2 \ / 22 \ 

Vn>n 5 , F(\a n - a\ > r, s ) < 2 exp ( - \ " J < 2 exp (-— n). (23) 

Defining = min(a^, r] 2 c 2 /(Ci + C 2 r]sc)) and collecting (f2"T j) - (|2"3"]) give the result. ■ 
Proof of Corollary [TJ It remains to verify that the difference 

D n {x) = — r^{c n - c)(/„ (x) - /(x)) 

can be neglected in the central limit theorem. In this aim, let (xi, . . . , x p ) C F. For all r\ > and 
5 > 0, we have 

P ( max lA^)! > n) < P(|c„ -c| > 6) +P ( max -J£_|/ B ( Xi ) - /(^-)| > ryc/^ , 
where the first term converges to as n — ¥ oo in view of Lemma [3j Thus, 

limsup P ( max \D n {xj)\ > r\ ) < limsup P ( max — \ \fn( x j) — f( x j)\ > ) 

\l<]<PK n fe / 

maxJG,!^^/^, (24) 

where (Gi, . . . ,G P ) follows the distribution N(0, E( X i,...,x p )) under the conditions of Theorem [TJ 
Letting 5 -> in yields 

limsup P I max \D n {xj)\ > r) \ = 0, 
n->oo \i<i<p / 

and therefore {D n (xj), 1 < j < p} — > 0. ■ 

5 Applications 

We first introduce a general class of kernel estimators which will be shown to satisfy our main result 
given in Theorem [TJ Then, we focus on the particular cases of Parzen- Rosenblatt and Dirichlet 
kernels. 

5.1 General kernel estimates 

Consider an unbiaised version of Geffroy's estimator: 

7„(x)=^l 7 _(x)(l + A^i)y n * r . 

r=l 

In order to smooth this estimator, a sequence K n : E x E — > M, of general smoothing kernels 
is introduced. Conditions on this sequence will be imposed later. The general kernel estimate is 
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defined by 



/»(*)= / K n (x,t)f n (t)v(dt) 
Je 



(25) 



It appears that Ip5]) is a particular case of ([3]) with k„ iT . (it) = ^„ J, J"j F„ (x, t) (c?t) . In the case 
where the calculation of this mean value is computationally expensive, it can be approximated by 
K n (x, x n>r ) for some x n>r G I n ,ri leading to the simplified estimate 



fn(x) = ^ Vn.r K n (x, X n>r ) (l + N n ^) Y* r , 
r=l 

which is still a particular case of (j3|) with K n ,r (x) — K n (x, x n ,r) ■ 

In order to introduce the assumptions needed on K n , we set, for all x G E, 

T n (x) = maxsup{F„(:E,i) -K n (x,s) : (s,t) G 7 n>r x /„,,.} 

r<k n 



(26) 



and 



(a:) 



K n {x,t)f{t)v{dt)-f{x) 



For the sake of simplicity, assume that, for all n > 1, the partitions {I nr '■ 1 < r < &n} are such 
that iVr = fc r T 1 f° r all r — ^n- Finally, for all function g : E — > K, we note 



J E \g{t)\v{dt), || 5 || 2 = (7 <? (*)%(<**)) 



1/2 



and h\\ E = sup |s (t) | . 



In this context, the general assumptions (H.1)-(H.6) can be simplified as: 
(H'.l) k n f oo and n -1 fc„ log (n) -> as n -> oo. 

(H.2) < m < M < +oo and nA;~ 1 A n — > as n -> oo. 

(K.O) For all n > 1, J ExB |F„(x, t)| i/ (da;) i/ (di) < oo. 
(K.l) For all (xi,x 2 ) G F x F, 

T n (x 1 )\\K n (x 2l . )\\ x = o(\\K n (xi, . )|| 2 ||if„(x 2 , • )ll 2 ) asn-s>oo. 

(K.2) For all (x 1( x 2 ) G F x F, 

(K n (x!, .),K n (x 2 , ■)) 2 (\\K n (x 1 , .)\\ 2 \\K n (x 2 , . )ll 2 )~ <7(xi,x 2 ) as n -> oo. 

(K.3) For all x G F, 

fc~ 1/2 ||if n (x, . )ll 2 _1 H-^nOC) • )||_e -> as n -> oo. 

(K.4) For all x G F, 

nfc~ 1/2 ||F„(x, OH^ 1 max(f„ (i); A„ \\K n (x, . )|| x ) ->■ as n -> oo. 
(K.5) For all x G F, 

nfc~ 1/2 ||F„(x, ■ )ll 2 ~ 1 ^E _/ ( K n(x,t) -K n (x,x nir ))v(dt)\ ->-0asn^oo. 



The results established in Section [3] yield: 
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Theorem 2 a) Under (H'.l) , (H.2) , (K.O) - (K.4) , and for all ( Xl ,...,x p ) C F, 

{nck-^ 2 \\K n (x j7 Olla^/nfoWte)) :l<i<p}^Ar(0,£ Cxi> ... )Xp) ). (27) 

b) If moreover, (K.5) holds, then for all (xi, x p ) C i* 1 , 

{ncfc-^Hifn^, Olls^/nfe)-/^)) :l<J<p}^^(0,S (Bli ... iBp) ). (28) 

c) ( |^7p and a/so ZioZd w/ien c is replaced by c n . 

Proof, a) For all x £ F, we just verify (H.l) — (H.6) for K n , r (%) '■— k n Jj K n (x, t) v (dt) . 
(H.l) and (H.2) hold trivialy. Moreover, by (K.l), 



^ tn,r (xi) K n>r (x 2 ) = fc% ^ / / KnO^l) s)K n (x 2 ,t)v (ds) V (dt) 

r=l r =lJ I n ,r J I n ,r 



■■ k n (K n (xi, . ),K n (x 2 , ■ )) 2 

fc «£ A / ifn(x2,t)(X"„(a! 1 ,«)-iir n (xi,t))i/(dt)i/(<i«) 



r=l 



Hence, 

and (K.2) leads to 



= k n (K n (x u .),K n (x 2 , .)) 2 + fc n O ^ r„(a;i) jf |lf n (ara,t)|i/(tft)j 
= fc„[(if„(xi, .),K n (x 2 , ■ )) 2 + o(\\K n (xi, . )\\ 2 \\K n {x 2 , . )|| 2 )] • 

«nW =fcy 2 ||K„(x, .)|| 2 (l + o(l)), (29) 

fen 

^ !«n,r (aCl) «W (x 2 ) = C^ll £B 2 ) + O (l) , 



which is (H.3) . Now, (|29l) entails for all large n, 

max \w ntr (x)\ <2k~ 1 ^ 2 \\K n (x, . )||r fc„ max / K n (x,t)v(dt) 

l<r<k n ' ' '" l<r<fc Tl 

— > as n — > oo by (K.3) , 

i.e. (H.4) holds. In order to show (H.5) , note that using (|2"9"|) again in combination with Fubini 
Theorem (which holds by (K.O)) and the triangle inequality yield 



K n (x) 



^ ^ ^n,?-^n,r (^) fn,r ffa 



K n ( X ) 



< 



K n ( X ) 



r=l 

fen 



K n (x,t) f (s)v (dt)v (ds) - f(x) 



#n(s,*) (f(s)-f(t))v(dt)v{ds) 



I„, r X/„,r 



fen 



(x, i) i/ (dt) 



re n (x) 
+ (x) I 



*n (a?) 



< 2nfc~ 1 / 2 ||^„(x, . )||- 1 (A„ \\K n (x, . )Hi + *„ (s)) 
— > as n — > oo by (K.4) . 
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Finally, we show that (H.6) holds. Since max \Jn8 n ) , A„ J = o (nk n 1 A„) , it follows that 

fen 

^ |to nj r(a;)| max ((n<5„) 2 , A„ 

r=l 

fen 

<2k~^\\K n {x, OII^E^ 



K n (x,t)v (dt) 



o [n 



= o(nk- 1 / 2 \\K n (x, .)\\- l \\K n (x, .)\\ 1 A n )=o(l) by (K.4) 
and, since, by (H'.l) , nexp (— mcnfc^ 1 ) — > 0, 

\ w n,r(%)\nk~ 1 exp (— mcnfc" 1 ) < nexp (— mcnfc~ x ) max |w„ !r (x)| 



o( ^ax |iu n , r (a;)| ) =o(l) by (H.4) 



b) For all x £ F, it is easy to see that 



fn(x) - f n {x) 



fen 



< 4Mnk-^ 2 \\K n (x, . )|| 2 1 I {K n (x,t)-K n {x,x n , r ))v{dt) 

= o(l) by (K.5), 



which, combined with (a), give the intended result by standard arguments, 
c) is straightforward by Corollary [1] ■ 

Two illustrations of this result are now provided. See Menneteau (2003b) for other applications. 



5.2 Parzen kernel estimates 

In the following, we take E = [0, l] d (d € N*) , v is the Lebesgue measure on E and {I n ,r ■ 1 < t < k n } 
an adjacent equidistant partition of E such that I n>r — 4,r,j where the J n ,r,j are interval 

of [0, 1] of length k n 1 ^ d , leading to v n>r — k^ 1 for all 1 < r < k n . Besides, we denote by x n>r the 
center of the cell I n ,r, T — 1, . . . ,k n . The multivariate Parzen kernel estimate is then defined by 
the kernel 

where K PR : K d — > R + is a 1-Lipschitzian Parzen-Rosenblatt kernel with compact support JC, and 
(h n ) is a sequence of positive real numbers tending to zero. It tunes the smoothing introduced by 
the kernel. For a review on non-parametric regression, see Hardle (1990). We suppose that / is 
a-Lipschitzian (0 < a < 1), in particular, 

A„ = O (fc~ Q/d ) . (30) 
Corollary 2 Assume that (i) n _1 A; n log (n) — » 0, (ii) h^k n — > oo and (Hi) nk n 1 ^ 2 hn +d ^ 2 — > then 

° d 

for all (xi, x p ) c E = (0, 1) , 

{v n c (fn(xj) - f( Xj )) :l<j<p}^N(0, \\K PR \\\l p ) , (31) 

where I p is the identity matrix ofM. p and v„ — nhf/ 2 k n 1 ^ 2 . 

The choice h n = n~^+3 and k n = n^+^u^ lead to v n = n^T^it" 1 , where u n oo arbitrary slowly. 
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Proof. (K.O) holds trivialy and assumption (i) gives (H'.l) . To show (H.2), note that entails 

nfc- x A„ = O (nk^ 1+a ^) (32) 

and thus, by (ii) and (iii) , 

O 

Let us consider now (K.l) — (K.4). To this aim, set x E E. For large enough n (i.e. such that 
JCdh^{x-E)), 

-PRr.A^. _ 1 (33) 



\\K n (x, .)lli= / ^(ujdu = 1. 



\\K n ( X , ■)\\ 2 =hr, 



1/2 



(tf P *) 2 ( U )dl 



K 



PR\ 



(34) 



(*) = h~ d I K PR (h- 1 (x - t)) (f (f) - / (*)) dt 
K pA {u) (/ (x-h n u)-f(x))du 



K 

= 0{h a n ). 

Moreover, since K PR is 1-Lipschitzian, 

T n (x)=0(k-^h-^ 
To check (K.l), take (xi,x 2 ) G F x F, then ([33]) , ([34]) , ([36]) and (ii) entail 

r n ( Xl )\\K n (x 2 , .)\\ l = o(k 7 y d h-^) = {k n h d n y 1/d o{h- d ) 

= o(\\K n (x u . )|| 2 \\K n (x 2 , . )|| 2 ) , 
(K.2) follows from the fact that for x\ ^ x 2 , we eventually have, 

(K n (x u .),K n (x 2 , -)) 2 = h- d [ K PR (u)K PR (u + h- 1 {x 1 -x 2 ))du = 0. 

Jh- 1 (x 1 -E) 

For (K.3), note that, for all x G F, 

K^WK^x, OH" 1 \\K n (x, .)\\ E = ^ 2 h^ 2 \\K 



(35) 



(36) 



PR] 



1 2 " 



LfiC 



Pi?, i 



= (1) 



with (ii). Finally, for all x E F, (|33|) — (|35|) , (ii) and (hi) entail 

nk- 1 ' 2 \\K n {x, OH" 1 max(* B (i); A n \\K n {x, . )||J = O (nfc,; 1/2 /^ /2 + fc-" /d 

= O (nfc- 1 / 2 ^) = (1). 

The end of the proof is straightforward. ■ 

From the asymptotical point of view, /„ is better than /„ and than the estimator based on 
Parzen kernel proposed, in the unidimensional case, by Girard & Jacob (2001). When / is 
a-Lipschitzian, the speed of convergence of f n can be chosen arbitrarily close to the minimax 
speed n~^+ 3 (see Hardle et al (1995b)). Let us also note that the regularity of /„ and f n is 
determined by the choice of the Parzen-Rosenblatt kernel. 
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5.3 Projection estimates: Dirichlet kernels 

In the sequel (b n ) is a sequence of integers tending to infinity. Let (ej)j^ be an orthonormal basis 
of L 2 (E, v). The expansion of / on this basis truncated to the b n first terms is noted 

fn{x) = ^ajejix), xeE. 

3=0 



IE ' 

a 3,k„ 



Each aj — J E e.j(t)f(t)v (dt) is then estimated by 
leading to an estimate f n {x) of f n {x) via: 

f n ( X ) =^S jlknat (x) = E ( / K n (*.*)" (*) J C 1 + ^r)^,r 

where the Dirichlet's kernel associated to the orthonormal basis (ej)j e ^ defined by 



(37) 



K°(x,t)=J2e j (x)e j (t), (x,t)eE 2 . (38) 



It appears that ([37]) is a particular case of (|25|) with _ftT„ = i<T„ . Of course, the sometimes more 
easy to handle estimates 

k„ 

f n (x) = £ v n , r K%{x, x n , r )(l + N~l)Y* tT , (39) 

r=l 

can also be defined. Below, we focus on the trigonometric basis on E = [0, 1], v is the Lebesgue 
measure on B, {/„. r : 1 < r < fc n } is the equidistant partition of 2? and then v n ^ r = l/k n for all 
1 < r < k n . This basis is defined for x € [0, 1] by 

e$(x) — 1, e2fc-i(a;) = V2 cos (2kirx), e-2k(x) = a/2 sin (2fc7ra;), fc > 1. 
It is easily seen in that case that the Dirichlet kernel is 

^(^^ Sin((1 + V 7r( ;' t)) for^t 
sin (7T (x — t)) 

= i + b n a x = t. 

In the following, we assume that / is C 2 . In particular, 

A„ = O (fc,; 1 ) . (40) 

Besides, we introduce the boundary conditions /(0) = /(l) and /'(0) = /'(l). 

Corollary 3 Assume that (i) n~ 1 k n log(n) — > 0, (m) n' 1 ^ — > oo, (tii) (6„ log (6„)) _1 fc„ — > oo 
onrf (u>,) nk n 1 ^ 2 6„ 3 ^ 2 — > 0. Then, for all (xx,...,x p ) C [0,1], 

{«„c (/„(x,) - />,)) : 1 < j < p] ^ JV (0,/p) , (41) 

where v n = n(6 n fc Il )- 1 / 2 . TTie choice b n — and k n = log (n) it 2 leads to v n — ni log (n) it^ 1 , 
where u n — ¥ oo arbitrarily slowly. 
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Proof. (K.O) holds trivialy. Assumptions (i) and (ii) give (H'.l) and (H.2). The following facts 
are well known (see e.g. Tolstov (1962)) 

\\K%(x, .)\\ E = l + b n , \\K°{x, .)|| 2 = (1 + M 1/2 , K(x, .)\\ 1 =OQog(b n )), (42) 
(K n (x 1} . ), K n (i2, ■ )) 2 = K n (x 1 ,x 2 ) = o (bn) for x\ ^ x 2 - (43) 

Since / is C 2 , and taking into account of /(0) = f(l) and /'(0) = /'(l), a double integration by 
parts yields, 



max j 2 I f (t) e 3 (t) dt = O (1) 



Hence, 

(x) 



E / f(t)ej(t)dtej(a 
i>b n Ja 



0( £r 2 ] =0 (6- 1 ) . (44) 

U>*>r> 



Moreover, since max j 1 ||e^ = O (1) , the Taylor formula gives 

T„ (x) < ^ \ e j( x )\ sup{ej(i) - e 3 (s) : (s,t) £ l. n , r x l n ^} 

= ° ( fc " 1 S J ) =0(fc- 1 6 2 ). (45) 

Finally, (j42|) — (j45]l together with (i)-(iv) imply (K.l) — (K.4), the proof being similar to the one 
of Corollary [2] ■ 

In this situation, both estimates /„ and f n are C°°. From the asymptotical point of view, f n is 
better than f n and than the estimator based on projections proposed by Girard & Jacob (2003b). 
Nevertheless, when / is C 2 , the above estimates are suboptimal, since the minimax speed of 
convergence is n -2 / 3 (see e.g. Hall et al (1998)). The use of expansions on wavelet bases should 
lead to a better speed of convergence. This is part of our future work. 

We refer to Girard & Menneteau (2002) for a brief comparison on simulations of some of the 
previous estimates. Let us also emphasize that in such finite sample situations, the quality of the 
estimation strongly depends on the choice of the hyper-parameters. The estimates of type (b) 
described in introduction and more generally the estimates ([3]) require the choice of two hyper- 
parameters: the number of extreme values (k n ) and a smoothing parameter (b n or h n ). Similarly, 
the estimates of type (a) usually require to select two hyper-parameters: the rate of decrease of 
the density towards (noted /3 in the introduction) and the number of continuous derivatives of 
/ (noted q in the introduction). In our opinion, one of the main problems in both cases is now to 
define an adaptive method for choosing the hyper-parameters. 

6 Appendix 

We provide a general theorem about the central limit property of a sequence of random R p valued 
vectors 



^ ^ ^n.rCn,r ; ^ ^ 1) 



r=l 



where (w n ^ r ) 1<r<k C W and (Cn,r)i< r <& are random variables such that: 
(A.l) (Cn,r) 1<r < fc are centered and independent random variables. 
(A.2) max |E (C 2 , r ) - 1 1 -> 0. 

l<r<k n ' 

(A. 3) There exists a covariance matrix E in R p such that for all A € M. p , 

^2 ( W n,r, A) 2 ,,, -» 'ASA. 



r=l 
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(A.4) max \\w n , r \\ Rp =o(l). 

l<r<k n 

(A. 5) lim sup lim sup max E ((^ r l{|f ra r |>a}) = 0- 

q->oo n->oo l<r<fc„ 

Theorem 3 Under assumptions (A.l) — (A. 5), 8 n N (0, S) . 

Proof. We have to show that, for all A G R p , 

A) Rp N (0,* AEA) . (46) 

Now, by Lindeberg Theorem (see e.g : Dudley (1989) p. 248), it is easy to see that (|4"6")l holds 
whenever for all e > 0, 

k n 

limsup £ A )w ,E (^.r 1 {|<«„, r ,A) w ,C».r|> e }) =0 - (47) 

r— 1 

Fix A £ MP, e > and a > 0. Using (A.4) , we get for all n large enough and all 1 < r < k n that 
1 {|(^.„A) RP c„,.|>4 ^ 1 {ICn,.|>«}- Hence, 



linl _^ P £^' A )KP E (Cn,r 1 {|(«„, r ,A) Jlpfn , r .|> £ }) 



r=l 

< limsup y~] {w n r , A)L max E .1 

n-s-oo \ i / l<r<k n 



r- L {|Cn,r|>a}J 



<* ASA limsup max E (Cn,rl{|Cn r|>«}) • 



and we get the result by (A. 5) when a f oo. ■ 
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